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■ Abstract 

In this article, we establish orientation and connectivity based criteria for the agreement 
algorithm to achieve asymptotic consensus in the context of time-varying topology and com- 
munication delays. These criteria unify and extend many earlier convergence results on the 
agreement algorithm for deterministic and discrete-time multiagent systems. 
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1 Asymptotic consensus in a multiagent system 



Let us consider a set of autonomous agents that interact with each other by exchanging values and 
perform instantaneous operations on received values. Agents each start with a real value and must 
reach agreement on a value which is a convex combination of the initial values. The agents are not 
required to agree exactly as in the decision problem called consensus in fault-tolerance [13], but 
ought to iteratively compute values that all converge to the same limit. 

The motivation for this asymptotic consensus problem comes from a variety of contexts involving 
distributed systems. For example, sensors (altimeters) on board an aircraft could be attempting to 
£T) \ reach agreement about the altitude. Or a collection of clocks that are possibly drifting apart have 

to maintain clock values that are sufficiently close. 

For the multiagent systems described above, the asymptotic consensus problem has been pro- 
posed a solution which consists in an iterative linear procedure, classically referred to as the agree- 
ment algorithm. It has been introduced by DeGroot [5] for the synchronous and time-invariant case, 
and then has been extended by Tsitsiklis et al. [181119] to the case of asynchronous communications 
and time-varying environment. A related algorithm has been later proposed by Vicsek et al. |20] as 
a model of cooperative behavior. The subject has recently attracted considerable interest within 
the context of flocking and multiagent coordination (see for instance \12\ [T4| HJ US] for surveys and 
references) . 

In this article, we establish orientation and connectivity based criteria for the agreement al- 
gorithm to achieve asymptotic consensus in the context of time-varying topology and commu- 
nication delays. These criteria unify and extend earlier convergence results, namely the one 
in |18t \19\ \TQ \10\ El El [T71 [TT] , and notably concern the coordinated and the decentralized models 
of multiagent systems that we define by simple orientation and connectivity properties on their 
communication graphs. 

Our proofs of convergence rely on uniform techniques. They share the same core, and only differ 
in the control of the convergence speed: in coordinated systems, the convergence speed depends 
quadratically on the number of agents while it is finite but unbounded in decentralized sytems. 
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1.1 The agreement algorithm with time- varying topology and communication 
delays 

We briefly recall the model for the agreement algorithm, and the set of assumptions that are usually 
made. We consider a set of N agents denoted 1, ••■ ,N. We assume the existence of a discrete 
global clock and we take the range of the clock's ticks to be the set IN of natural numbers. The 
state of the agent i is captured by a scalar variable Xi, and the value held by i at time t is denoted 
Xi(t). Each agent i starts with an initial value Xj(0), and the evolution of the local variable Xi is 
described by the linear transition function: 

JV 

x i {t + i) = ^2A u (t)x j (nj(t)) ■ (l) 

Equation ([TJ corresponds to the fact that at each time t + 1, the agent i updates Xi with a weighted 
average of the values it has received at time t. In the presence of communication delays, the value 
received by i from j at time t may be an outdated value, i.e., sent by j at some time T{j (//) with 
T~ij{t) ^ t. For each time t, we form the N x N matrix A(t) and the communication graph 
G(t) = ([iV] ,E(t)j which is the directed graph with a node for each agent in [N] = {1, • • • , N} 
and where there is an edge from i to j if and only if Aij{t) > 0. In other words, the agent % is 
connected to the agent j in G(t) if % hears of j at time t. 

We now formulate a series of assumptions on the matrices A(t) and the delays Tij(t), which 
hold naturally in the context of a multiagent system running the agreement algorithm. 

Al: Each matrix A(t) is stochastic. 

A2: Each communication graph G(t) contains all possible self-loops, i.e., Aa(t) > for all i G [N]. 

A3: The positive entries of the matrices A(t), t G IN, are uniformly lower bounded, i.e., there exists 
a e]0, 1] such that A itj (t) G {0} U [a, 1] for all i,j G [N] and all t G IN. 

Concerning the delays, we assume 

Bl: Tij(t) < t, for all i,j G [N] and all t G IN. 

B2: Tu(t) = t, for all i G [N] and all t G IN. 

B3: There exist some positive integer A such that ^ max(0,t — A + 1) for all i,j G [N] and 

all tel. 

Assumption Al corresponds to the updating rules of the Xj's in terms of weighted averages discussed 
above. Assumptions A2 and B2 express the fact that an agent has an immediate access to its 
own current value. Assumption A3 is obviously fulfilled when the set of matrices A(t) is finite. 
Assumption Bl captures the fact communication does not violate causality: a future value of 
agent j cannot influence the computation of agent i's value. Finally, with assumption B3 we 
suppose the multiagent system to be partially synchronous, namely communication delays are 
bounded. However since we do not require the functions Tj,- to be either non-decreasing, surjective, 
or injective, communications between agents may be non-FIFO and unreliable (duplication and 
loss). The case of zero communication delays is captured by assumptions A and B with A = 1, and 
equation ([T]) corresponds in this case to the evolution of the agreement algorithm for a synchronous 
multiagent system. 



2 



1.2 The coordinated and decentralized models 

All the above assumptions are classical, contrary to the conditions C and D we introduce now, that 
lie at the heart of our main convergence theorems. 

Let us recall that for a directed graph G, its strongly connected components are, in general, 
strictly included into its connected components defined as the connected components of the undi- 
rected version of G. Let us also recall that the directed graph G = (V,E) is said to be j- oriented, 
for j E V, if for every node there exists a directed path originating at this node and terminating 
at j [7\. If G is j-oriented for some node j, then G is said to be oriented. We now introduce the 
following condition on sequences of communication graphs. 

C : At every time t € IN, the communication graph G(t) is oriented. 

Intuitively, while the communication graph is j-oriented, the agent j gathers the values in its 
strongly connected component, computes some average value, and attempts to impose this value to 
the rest of the agents as long as the communication graph remains j-oriented. In other words, its 
particular position in the communication graph makes j to play the role of system coordinator for 
the agreement algorithm. Accordingly, we define the coordinated model as the model of multiagent 
systems which, in addition to assumptions A and B, satisfy condition C. 

From the above discussion about the role of coordinator, it is easy to grasp why in the particular 
case of a steady coordinator, all the agents converge to a common value when running the agreement 
algorithm. Our first theorem shows that asymptotic consensus is actually achieved even when 
coordinators change over time. 

Theorem 1. In the coordinated model, the agreement algorithm guarantees asymptotic consensus. 

We introduce a second model of multiagent systems, the decentralized model, in which the 
orientation condition C of the coordinated model is replaced by two connectivity conditions Dl 
and D2. Before stating them, let us recall that a directed graph is said to be completely reducible 
if all its connected components are strongly connected. 

Dl: For every time t € IN, the directed graph ([N] , U s ^tE(s)) is strongly connected. 

D2: At every time t € IN, the communication graph G(t) is completely reducible. 

The second main result of this paper is the following convergence theorem for the agreement 
algorithm. 

Theorem 2. In the decentralized model, the agreement algorithm guarantees asymptotic consensus. 

The convergence mechanism behind this result can be understood as follows in intuitive terms: 
there is no source (that is, no node without incoming edge) in a completely reducible directed graph, 
and thus for the decentralized model, there is no dead end in the information flow of each connected 
component of the communication graph. The strong connectivity condition Dl guarantees that the 
values computed in each connected component are then spread out over the whole system. Even if 
at a given time, the roles performed by agents may be not at all equivalent since the communication 
graph may be non-symmetric, all the agents eventually play the same role over time and converge 
to the same value. 

Because of the self-loop assumption A2, the decentralized model corresponds to a weak form 
of ergodicity, namely each matrix A{t) is block ergodic. Similarly, a close inspection of our proof 
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of Theorem [T] reveals that in the coordinated model, each matrix A(t) is "partially ergodic" in the 
sense that there exist some index j in [N] and some positive integer n such that all the entries in 
the j-th column of the matrix (yl(i)) n are positive. Clearly a matrix that is both block ergodic 
and partially ergodic is ergodic. Since a strongly connected directed graph is oriented with respect 
to each of its nodes, the intersection of the coordinated model and the decentralized model indeed 
coincides with the model where communication graphs are all strongly connected. 

1.3 Some strengthenings of our convergence theorems 

Theorems [1] and [2] admit generalizations — which turn out to be useful in applications — where 
conditions C and D are weakened in diverse directions while maintaining convergence. 

Firstly, convergence is maintained when condition C (resp. D) holds only eventually: C (resp. 
D) may be violated during a finite period, but is supposed to hold from some time onward. Roughly 
speaking, that corresponds to a realistic situation where the multiagent system stabilizes after some 
transient phase during which the communication graph is arbitrary, of duration unknown to the 
agents. 

Secondly, we may address the issue of the granularity at which condition C (resp. D) holds: 
instead of observing the multiagent system at each time t G IN, we might have access to its state 
only at the end of each period of time of a fixed duration <£. Formally, that corresponds to the 
introduction of a new time scale u £ IN, and to let t = &u. In the synchronous case where we 
assume Tij(t) = t, the evolution equation ([1]) takes the form 

N 

a*($(u + l)) = ^AisMxy^u) (2) 
j=i 

where A = A(&u + <3? — 1) • • • A($u). In other words, in the synchronous model, the change of 
granularity amounts to grouping the matrices in blocks of length $, and in replacing each block 
by the product of the matrices in the block. It is remarkable that, in the general non synchronous 
case captured by assumption B, where the maximum delay A is any positive integer and where the 
system evolution does not follow equation ([2]) anymore, asymptotic consensus is still guaranteed 
under a simple extension of condition C involving matrix products of length <3?. 

Actually, these two types of weakening of conditions C and D can be combined in the following 
formulations, respectively. 

OC: There exist a time To E IN and a positive integer <3? such that at every time t ^ To, the 
communication graph H (t) of the product A(t + <& — 1) • • • A(t) is oriented. 

0D2: There exist a time To G IN and a positive integer $ such that at every time t ^ To, the 
communication graph H {t) of the product A(t + $ — 1) ■ ■ ■ A{t) is completely reducible. 

Simple extensions of our proofs will allow us to show the following generalizations of Theorems Q] 
and El 

Theorem 3. Under assumptions A and B, the agreement algorithm guarantees asymptotic consen- 
sus when condition OC holds. 

Theorem 4. Under assumptions A and B, the agreement algorithm guarantees asymptotic consen- 
sus when condition ()D, the conjunction of Dl and ()D2, holds. 
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Beside the above variants of conditions C and D (derived from C and D by a weakening procedure 
standard in temporal logic), a close inspection of the proof of Theorem [2] leads us to introduce 
another weakening of condition D. Indeed, our proof shows that the agreement algorithm achieves 
asymptotic consensus when replacing condition D by the following weaker condition. 

D* : There is some j € [N] such that at every time t 6 IN, 

1. the directed graph ([N] ,U s ^tE(s)) is j-oriented; 

2. the connected component of j in the communication graph G(t) is j-oriented, and every 
other connected component of G(t) is strongly connected. 

Theorem 5. Under assumptions A and B, the agreement algorithm guarantees asymptotic consen- 
sus when condition D* holds. 

Contrary to the coordinators in condition C, the agent j in condition D2* is fixed in time. 
Indeed, the combination of conditions C and D2* defines a simple model of a steady coordinator. 
One point of interest in Theorem [5] is that it demonstrates that asymptotic consensus can be 
achieved in a hybrid model: agents can be disconnected from the coordinator provided they are 
still clustered into independent and strongly connected groups. 

1.4 Related work 

Numerous convergence results for the agreement algorithm have been established in the literature. 

Presumely, the first one, which is a straightforward corollary of the classical Frobenius' theo- 
rem [6], concerns the case of a fixed ergodic matrix in the synchronous setting. Wolfowitz's theo- 
rem [21] extends this result to the sequences of varying matrices taken from a finite set of ergodic 
matrices such that any finite product of matrices in that set is ergodic. We refer the reader to |16| 
for historical references and variants of these theorems. 

Bertsekas and Tsitsiklis [1] introduced the set of assumptions A and B to relax the finiteness 
hypothesis on the set of matrices and to handle communication delays. Moreover they defined a 
condition on the sequence of communication graphs, the condition of ^-bounded intercommunication 
intervals, where $ denotes a positive integer: if (i,j) is an edge of the communication graph 
infinitely often, then is required to be an edge of the communication graph at least once 

during each period of duration <I>. Tsitsiklis [18] proved that under assumptions A, B, Dl and 
on the condition of bounded intercommunication intervals, the agreement algorithm guarantees 
asymptotic consensus. It is easy to see that assumptions A2 and Dl combined with the condition 
of ^-bounded intercommunication intervals imply that from some time onward, any product of <&N 
consecutive matrices in the sequence (A(t))t^ is a positive matrix. Thereby condition (>D holds 
and the convergence result in [18] appears as a special case of our Theorem [H 

Moreau |14j and Hendrickx and Blondel [10] independently proved that in the synchronous 
case (A = 1), asymptotic consensus is still guaranteed when replacing the condition of bounded 
intercommunication intervals by a symmetry condition on the edges of the communication graphs, 
namely (i, j) € E{t) iff (j, i) E E(t) for any t € IN". The latter condition corresponds to a particular 
case of the decentralized model, and thus the convergence result in [14} 110] . as well as its extension 
in [2] to the case of bounded communication delays (assumption B), are contained in Theorem [2] 

Cao et al. [3] proved that in the case of stochastic matrices with equal positive entries in 
each row (usually referred to as the equal neighbor model), and under assumptions A and B with 
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A = 1, the agreement algorithm achieves asymptotic consensus when all the communication graphs 
are oriented. Their convergence result thus coincides with Theorem [1] in the particular case of a 
synchronous multiagent system and with the equal neighbor model. 

After writing the proof of Theorem [H we became aware of two recent papers both containing 
Theorem [2] in the synchronous case. In [11], Hendrickx and Tsitsiklis showed that the agreement 
algorithm achieves asymptotic consensus under assumptions A, B with A = 1, Dl and the so-called 
cut-balance condition. In light of Proposition 1271 below, the latter condition turns out to correspond 
to the decentralized model. Independently, Touri and Nedic [17] established a general convergence 
result for the infinite product of random stochastic matrices, and to do that, they first proved that 
this result holds in the deterministic case; see Lemma 5 in [17]. It is easy to see that this lemma 
actually coincides with our Theorem [2] in the particular case of a synchronous multiagent system. 
In fact, our technique for proving the lemmas in Sections 13.21 and 13.41 infra specialized to A = 1, is 
similar to the one used for the proof of the deterministic result in [IT] . 



2 A seminorm for multiagent dynamics 

In this section, we discuss some auxiliary convergence results that will enter enter in our proofs 
in Section [3l To illustrate their usefulness for the study of convergence of product of stochastic 
matrices, we also present a short proof of Wolfowitz's classical theorem based on them. 



2.1 An operator seminorm 

For any integer N ^ 2, we consider the seminorm on M, N defined as the difference between the 
maximum and minimum entry of vector x 

|| ar ][_!_= max(xj) — min(xj) . 

i i 

Thus ||x||_i_ is null if and only if x € ML, where 1 is the vector whose components are all equal to 
1. For any square matrix A with 1 as an eigenvector, the induced matrix seminorm ||^4||j_ is 

ii.ii \\Ax\\\ 
\\A |j_= sup 



One key property of the seminorm ||-||j_ is that it is sub-multiplicative, i.e., 

||ab||_l^ PILH^IL • 

Another one is about the vectors that realize 



Lemma 6. Let A be a square matrix with 1 as an eigenvector, and let {e% \ i £ [N]} denote the 
standard basis of H N . There exists a nonempty subset I of [N] such that the vector ej = Y^iel e * 
realizes ||-A||_l, i.e., 

\\M±= P(e/)|U ■ 

Proof. By linearity, we have 

\\A\\±= sup ||A(x)|U . 

11x11 I =1 
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Let re be a vector such that ||x[|j_= 1, and let X — X X<£q 1 where Xi = minj(ccj). Then ||x||j_= 1, 
and Xi = minj(xj) = 0. Since A(t) = 1, 



Moreover by compactness, there exists a vector x with maxj(xj) = 1 and minj(xj) = 0, and such 
that || J 4||j_= 

Now suppose that some entries of x are not in {0, 1}, and let Xj e]0, 1[ be one of them. We 
consider the two vectors x~ = x — Xj ■ e* and x + = x — (1 — Xj) ■ ej, and we denote y = Ax, 
y~ = Ax~ , and y + = Ax + . Then for any index i, we have y~ = y% — XjA^, yf = yi + (1 — Xj)Aij, 
and so y~ ^ yi ^ yf. Since ||x||j_= | [ a? 1 1 _i_ ^= ||^ + IU = 1> 1 1 2/ 1 1 _L an d ||y + ||_L are both less or equal 
to ||-A||j_. Let io and i\ be two indices such that ||y||j_= y% x — yi - Then 

Vh ~ Vi Q = \\ A h- x i( A hj ~ A ioj) and vt ~ vi = \\ A \\±+( l - Xj)(Ai d - A ioj ) . 

Prom xj e]0, 1[, y^ - y^ Q < \\A\\±, and yf - y+ sC \\A\\ ± , we derive that Aj^ = A ioj , and so 
||?/ _ ||j_= ||2/ + ||j_= One by one, we thus eliminate all the entries of x different from and 1, 

and obtain a vector of the desired form. □ 

Observe that if ej = e i realizes ||-A||j_, then so does e-j, where I denotes the complement 
of /within [N]. 

The vector 1 is an eigenvector of each stochastic matrix, and we easily check that for any 
stochastic matrix A and any vector x € M, N , 



It follows that the induced matrix seminorm of a stochastic matrix is less or equal to 1. 

Interestingly we can compare with the coefficients of ergodicity of A previously introduced 

in the literature [9l [2JJ , namely 



-A||j_= sup < ||Ac||_i_ | x £ R with max(xj) = 1 and min(xj) = 




5(A) = max max \Ai 2 j — A^j 



and 



N 




Proposition 7. Let A be a stochastic matrix. Then 



6(A) < \\A\\ ± ^ \(A) . 



Moreover \(A) = 1 if and only if ||-A||j_= 1. 
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For the second inequality, we consider a realizer of ||j4||j_ that we denote ej = Ylii^i e i ( c ^- 
Lemma [6]). Let / = Aei, f a = maxj and fp = min^ f{. Then we have 

||A||x= J2( A "i ~ A ^ ■ 
Since A is a stochastic matrix, we get 

N 

1 - \\A\\ X = 52 A aj - 52( A *j ~ A Pi) = E A <*i + E A ^ ■ 

3=1 j el j0 j£l 

Hence 

N 

1 ~ MIU^ ^min(i a j,ift-) , 
i=i 

and the inequality A (A) immediately follows. 

Suppose now that X(A) = 1, i.e., there exist two indices i\,i2 such that for each j G [iV], 
either = or Ai 2 j = 0. Let I = {j £ [N] \ A^j ^ 0}, e/ = X^ig/ e *' an d / = ^ e -f- Since 
A is stochastic, its ii-th and *2-th rows each contains a non-null entry, and thus neither / or its 
complement is empty. Hence 

f h = 1 and f i2 = , 

which shows ||j4||j_= 1. □ 

We now give a corollary that is useful for convergence proofs. 

Corollary 8. Let A be a N xN stochastic matrix, j be any index in [N], and let f3 j be the minimum 
of all the entries in the j-th column, i.e., f3j = min{^4j.j | % 6 [N]}. Then, 

N 
3=1 

In particular, if all the entries of one column of A are positive, then ||^4||j_< 1. 
Proof. Since all ^4's entries are non-negative, we have 

N 

X(A)^1-J2^ ■ 

3=1 

Using Proposition we derive that ||-A||j_ ^ 1 — /3j. In the case f3j > for some index j, we obtain 
I|A||.<1. □ 



2.2 A simple criterion for convergence 

Now we give a seminorm based condition on a sequence of stochastic matrices under which their 
product converges to a rank one stochastic matrix. This criterion lies implicitly behind several 
convergence proofs (for instance, see [TJ Section 7.3] or [2j [T7] and also [8] for related results 
concerning Markov operators on cones). 
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Proposition 9. For each integer t £ IN, let A(t) be a stochastic matrix, and let P(t) = A{t) . . . A(0). 
The following conditions are equivalent: 

1. The sequence (P(t)) t£K converges to a matrix of the form lir T where tt is a probability vector 
in R N . 

2. The sequence (||-P(i)|U) igW converges to 0. 

3. For each vector v € R , the sequence {P(t)v) t ^ converges to some vector in the line Rl. 
4- For each vector v S H N , the sequence (\\P(t)v\\±) t ^ converges to 0. 

Proof. The implications (1) (2), (3) (4), (1) (3), and (2) => (4) are obvious. 

To show that (4) => (3), we consider a sequence of vectors x(t) = P(t)v where v is some vector 
in R N . We denote 

M(t) = max (xi(t)) and m(t) = min (zj(t)) • 

i i 

Hence ||a;(t)||j_= M{t) — m(t), and (4) is equivalent to lim^oo M(t) — m(t) = 0. Since each matrix 
A(t) is stochastic, the sequences (M(i)) ^ and {m(t)) t ^ are non-increasing and non-decreasing, 
respectively. It follows that the latter two sequences as well as all the sequences (xi(t)) t ^ are 
convergent to the same limit, which shows (3). 

For the implication (3) =>■ (1), suppose that (3) holds. In particular with v = ej, each sequence 
[Pij(t)) t&K converges to some scalar j independent of index i. Therefore, the sequence (P(t)) tgIN 
converges, and lim t _> +00 P(t) = tir T '. Since each matrix P(t) is stochastic and the set of stochastic 
matrices is closed, n is a probability vector. □ 

As an immediate consequence of Corollary [HI the sub-multiplicativity of the seminorm ||-||j_, and 
Proposition [9l we obtain the well-known result that for any ergodic stochastic matrix A, limt_» 00 A 1 
exists and is a rank one stochastic matrix. In fact, we can even derive Wolfowitz's theorem |21j 
which generalizes the latter result to infinite products of matrices taken from a finite set of ergodic 
stochastic matrices. 

Theorem 10 (Wolfowitz). Let M be a nonempty finite set of stochastic matrices such that any 
finite product of matrices in this set is ergodic. For each t G M ; let A(t) be a matrix in A4. Then 
limt-j-i-oo A(t) ■ ■ ■ A(0) exists, and the limit is of the form tir T where it is a probability vector in 

Proof. We begin by mimicking the first steps of the proof in |21j with the seminorm ||-||j_ to be 
substituted for the coefficient of ergodicity A. Then instead of Theorem 2 of [9] used by Wolowitz, 
we just need the sub-multiplicativity of the seminorm to conclude. 
In more detail, we first show the following lemma. 

Lemma 11. The seminorm of any product of N 2 + 1 matrices in M. is less than 1. 

Proof. Let ~ be the equivalence relation defined on the set of square stochastic matrices by A ~ B 
iff A and B have the same communication graph. We easily check that ~ is preserved by (right) 
multiplication with stochastic matrices. Moreover, the conditions X(A) = 1 and \(B) = 1 are 
clearly equivalent when A ~ B. Using Proposition [7] twice, we derive that if A ~ B and ||A||j_= 1, 
then \\B\\ ± = 1. 
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Let Aq,--- ,A N 2 be iV 2 + 1 matrices in Ai. Since there are at most iV 2 equivalence classes 
under the relation ~, there exist two indices k, £, ^ k < £ ^ A^ 2 , such that 

A N 2 ■ ■ ■ Ai ~ A N 2 ■ ■ ■ Ak . 

Let A = Ajy2 ■ ■ ■ Ai and B = A^_\ ■ ■ ■ A^; we have AB ~ A. It follows that for any positive integer 
n, AB n ~ A. Moreover by assumption on Ai, the matrix B is ergodic, i.e., B n ° > for some 
positive integer no- 

Now suppose that ||-A||j_= 1. The above argument shows that || AB n ° ||j_= 1 and by the sub- 
multiplicativity of ||-||j_, we get H-B" -0 ||j_= 1, a contradiction with Corollary El Therefore, ||A||j_< 1. 
Using the sub-multiplicativity of ||-||j_ again, we obtain ||^4jv 2 • • • -Ao 1 1 _L < 1 as required. □ 

Let 5 denote the supremum of the seminorms of the matrices that are a product of N 2 + 1 
matrices in Ai. Since Ai is finite, there is a finite number of such matrices and Lemma [TT1 shows 
that 5 < 1. Using the sub-multiplicativity of the seminorm, the theorem immediately follows. □ 

In the next section, we show how to use the criterion in Proposition to prove convergence 
theorems where the finiteness assumption of the set Ai is weakened by assuming a uniform positive 
lower bound on positive entries (assumption A3), and where the ergodicity assumption is replaced 
by conditions that basically guarantee "eventual positivity" of some finite products of matrices 
in Ai. 

3 Convergence with bounded delays and topological changes 

This section is devoted to the proof of Theorems Q] and [2j In Section 13.11 we introduce a family 
of stochastic matrices (A A (t))t^K of size AA^, which allows us to express our original evolution 
equation ([1]) as a "zero delay" evolution equation of the form 

X(t + 1) = A A (t)X(t) 

on suitably defined vectors X(t). In Section [3.2^ we investigate the time evolution of the sets of 
positive entries in each column of the successive products of the matrices A^(t). The content of 
this subsection constitutes the core of our proofs of Theorems Q] and [2J Combined with a simple 
combinatorial argument, it allows us to conclude in Section l3T3l for the case of the coordinated model. 
Section [3^1 is dedicated to the study of the decentralized model. We start by deriving from condition 
Dl the eventual positivity of some columns of the successive products of the matrices A^(t). Then 
we refine the "stationarity" condition elaborated in Section 13.21 to prove that asymptotic consensus 
in the decentralized model. 

3.1 Reduction to the zero delay case 

We mimic the classical reduction of a A-th order ordinary differential equation to a system of A 
ordinary differential equations of first order. For any time t ^ A — 1, let X(t)(g t {\ denote the family 
in Rl A MN] defined by 

X{t) m = Xi (t-5 + l) , 
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where 5 € [A] and i € [N\. Letting <%(f) = t — Tij(i) + 1 € {0, • • • , A — 1}, equation ([I]) can be 
rewritten in the following way 



which is equivalent to 



X(t)(S-l,i) if*G{2,-.- ,A} 



EliAj(t)^(t)(i w( *),i) if 5 = 1 , 



A(* + l)(«5,i) - X] (*', j)^ X ^\s',j) 

(8',j)e[A]x[N] 

with 

'1 if i = j } 6' = 6 - 1, and S e {2, ■ ■ ■ , A} 

A id (t) if <5 = 1 and 5' = <%(*) 
otherwise. 

The key point here is that from time A — 1 on, the vector X is updated according to the linear 
equation with "zero delay" 

X(t + 1) = A A (t)X(t) . 

For ease of notation, in what follows we encode each ordered pair (5, i) in [A] x [N] into the 
integer k = Ai - 5 + 1 in [AN]. Then the vector X(t) is in R AN and A A (t) is a AN x AiV matrix. 
The updating rule for X(t) can be rewritten 

(Xk + i(t) if k is not a multiple of A 

n 
J2f =1 ^i,j(t)X Aj _ 5ij{t)+1 (t) otherwise. 

Using the Kronecker delta <5 m>n (not to be confused with the delays 6ij(t)), the above expression 
of ^f S ',j),(S,i)^ im P lies tnat 

1. A A n (t) = 5 m+ i tn if m is not a multiple of A; 

2. all the entries A^ a(j-i)+i(A)j • • • ; -^Ai Ajft) are nun exce Pt one which is equal to Aij(t); 

We observe that each matrix A A (t) is stochastic (Al), and every positive entry of A A (t) is at 
least equal to a (A3). However neither A2 nor Dl holds for the matrices A A (t), and the above 
reduction does not allow us to limit ourselves to the zero delay case A = 1 while maintaining the 
basic assumptions A and B. 

We now choose some time to ^ A — 1 which stays fixed in the rest of the section except in the 
very last steps of the proofs of Theorems Q] and [2j For any time t ^ to, we let 

P(t) = A A (t)...A A (t ) . 

Because of the above mentioned properties of the matrix A A (t), we have the following recurrence 
relations for P(i)'s entries: 

Rl: Pm t Aj(t + 1) = Pm+i,Aj{t), for each index m that is not a multiple of A; 

R2: Pm,Aj^ + 1) = EfcLi^-«,fc(* + -Q-^Wa/W' wnere for each index k in the sum, is some 
integer in {A(k — 1) + 1, ... , Ak}, and where rrik = Ak for k = i. 
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3.2 Positive entries in the Aj-th column 

In this section, we fix some index j G [N], and study the entries in the Aj-th column of P(t). We 
define the two sets 

Sf (t) = {m G [AiV] | P m , Aj (t) > 0} and S^i) = {i£ [iV] | P A i,Aj(i) > °i ■ 
Lemma 12. A j € S^(io)- 

Proof. By definition, P(to) = A A (to). The lemma directly follows from property (3) of the ma- 
trix A A (to), and from assumption A2 on the matrix .A (to)- □ 

Lemma 13. For all t ^ t , Sj(t) C S^t + 1). 

Proof. Prom the recurrence relation R2, we deduce that 

and the lemma follows from assumption A2 on the matrix A(t + 1). □ 
Lemma 14. For aZZ f ^ to, Sf(t) C S A (i + 1). 

Proof. First we give a more precise description of Sj(to). Since P(to) = A A (to), properties (1) 
and (2) of the matrix A A (to) implies that 

( m = Ai and A^ i Ai (t ) > 

m G Sf (to) ° 1 or 

^ m = Aj — 1 . 

Let t ^ t , and m G S^(t). We denote t = t + 9, and m = Ai — £ with i G [iV] and 
£ G {0, • • • , A — 1}. We consider two cases: 

1. e^£. 

By as many applications as possible of the recurrence relation Rl, we obtain 

PmAjit) = PAiAjito + O -£) and P m ,Ai(* + 1) = PAi,Ai(io + 1 + - £) . 
The lemma follows from Lemma [13] in this case. 

2. 6 <£. 

Then £ ^ 1, i.e., m is not a multiple of A, and we can apply the recurrence relation Rl to 
obtain 

PmAjv-) = PAi-e+6Aj(to) an d PmAjv- + 1) = PAi-e+e-iAjV'o) ■ 

In this case, Ai — £ + 9 is not a multiple of A, and from the above description of 5^ (to) follows 
that Ai — £ + 9 = Aj — 1. Hence P m Aj(t + 1) = Ajj(to). The lemma follows from assumption A2 
on the matrix A(to) in this case. □ 

By Lemmas [12] and [T3] each set Sj (t) is non-empty. We define -Kj (t) as the minimum positive 
entry in the Aj-th column of the matrix P(t), or 

7Tj(t) = min{P m ^j(t) | m G Sj (t)} . 
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Lemma 15. For all t ^ to, nj(t + 1) ^ aiTj(t). 

Proof. Let m G Sf(t + 1), i.e., P mAj {t + 1) > 0. There are two cases to consider: 

1. m is a multiple of A, i.e., m = Ai for some i G [N]. Relation R2 implies that 

PAiM* + !) > + 1) P Ai,Aj(*) • 

Since the matrix A(t + 1) satisfies A2 and A3, we have PAi,Aj(t + 1) ^ anj{t). 

2. m is not a multiple of A. By relation Rl, we obtain 

PmAj(t + 1) = P m +l,Aj{t) ■ 

Hence m+lG Sf{t), and thus PmAji 1 + 1) ^ 7Tj(*)- 
In both cases we have P mA j(t + 1) ^ a7Tj-(t), as needed. □ 

Lemma 16. Let t ^ to- -tf S^(t) = S^(t + 1), £/ien /or eac/i index ? in Sj(t), all the entries 
^A(i-l)+l,Aj(*)> • • • ,-FAi,Aj(*) « r e positive. 

Proof. Let j G By decreasing induction on m, A (i — 1) ^ m ^ A i, we prove that 

^m,Ai(t) > . 

1. The basic case m = Ai corresponds to i G Sj(t). 

2. For the inductive step, let us assume that P m) Aj(t) > with m G {A (i — 1) + 1, • • • , Ai}. 
Therefore, m — 1 is not a multiple of A and by relation Rl, we have 

Prn-lAj( t + 1 ) = PmAjit) ■ 

Hence m — 1 G Sj A (i+l). Since S^(t) = S^(t + 1), we obtain P m> Aj{t) > 0, as required. 

□ 

Lemma 17. If Sj(t) = Sj(t + 1), then Sj(t) has no incoming edge in the graph G(t + 1). 

Proof. By contradiction, suppose that Sf(t) =Sf(t+l), and that Sj(t) has an incoming edge in 
the graph G{t + 1). Hence there exist i and k in [N] such that PAi,Aj{t) = 0, PAk,Aj(t) > 0, and 
Ai,k(t + 1) > 0. Since Sf{t) = Sf(t + 1), we have 

PAi,Aj(t + l) =0 . 

Moreover Lemma [161 states that 

Vm G {A (fc — 1) + 1, • • • , A A;} : P mAj (t) >0 , 
and relation R2 implies that 

PAiAjtt + 1) > Ak(t + 1) PtM*) 
for some £ G {A (k — 1) + 1, • • • , A A;}. Hence PAi,Aj(t + 1) > 0, a contradiction. □ 
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3.3 Convergence in the coordinated model 

In this section, we consider the coordinated model (assumptions A, B, and C), and prove our first 
convergence theorem. 

We start by specializing Lemma [171 to the case of oriented communication graphs. Let us define 

S A (t) = {(m,j) € [AN] x [N] | m € Sf (i)} . 

Lemma 18. If G(t + 1) is j-oriented, then either S A (t) / S A (t + I), or S A (t) = [AN]. 

Proof. Suppose that S A (t) = S A (t + 1). Therefore S A (t) = S A (t + 1). Lemma [TTJ ensures that 
Sj(t) has no incoming link in G[t + 1). Since G(t + 1) is j-oriented, Sj(t) = [N]. By Lemma [T6| 
we conclude that S A (t) = [AN], as required. □ 

The latter lemma allows us to show that there is an agent j such that S A is equal to [AN] by 
time t + AN 2 - 2N + 1. 

Proposition 19. In the coodinated model, there exists an agent j such that 

Vm G [AN] : P m ,Aj(to + A^ 2 - 2iV + 1) > . 
Proof. Let t ^ to- As immediate consequences of Lemma [T2l and Lemma [T4"l respectively, we have 

\S A (t )\>N 

and for all t to, 

S A (t) C S A (t + l) . 

Using Lemmas [18] and [TH we obtain that either ^ A r + 1 — to or S A (t) = [AN] for some j 

in [iV]. We observe that if the cardinality of S A (t) is greater than AN 2 — N, then the matrix P(t) 
has at least one of its Aj-th columns with positive entries to complete the proof of the lemma. □ 

We are now in position to prove Theorem [TJ Let us consider an agent j such that 

Sf (t + AN 2 -2N + 1) = [AN] 

the existence of which is ensured by Proposition [T9j By Lemma [T5| we have 

tt j (to + AN 2 -2N + 1)2 a AN2 ~ 2N+1 . 

By Corollary El we derive ||P(t + AiV 2 - 2N + 1)\\±^ 1 - a AN2 ~ 2N+1 . In other words, we have 
shown that for any to ^ A — 1 

\\A A (to + AN 2 -2N + l)---A A (t )\\±^l-a AN2 - 2N+1 . 

Together with the sub-multiplicativity of the seminorm ||-||j_, this implies that 

lim \\A A (t)---A A (0)\\±=0 ■ 

t— >+oo 

Theorem [TJ then follows from Proposition [9] and the definition of vector X(t). 
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A(ii-1)+1 A(«-l)+2 



An-i 




A(i 2 -1)+1 A(i 2 -l)+2 Ai 2 -1 Ai 2 

Figure 1: Structure of G A {t) 

3.4 Convergence in the decentralized model 

We now consider the decentralized model (assumptions A, B, and D). Under the sole assumptions 
A and B, the set S A may remain small forever: for example, in the case of the sequence of the 
powers of the unit matrix, S A is constantly equal to the diagonal in [N] 2 . Firstly, we show that 
assumption Dl ensures that S A is eventually equal to [AN] x N. However, Dl provides no bound on 
the time required the set S A to be maximal, and so under assumptions A, B, and Dl, no positive 
lower bound on the positive entries of the matrix P are guaranteed. In the second part of this 
section, we show that assumption D2 allows us to control how functions 7r,- can decrease in time. 

We start by refining the strong connectivity property of the graph Go = ([N] , Uf^ i?(£)) ensured 
byDl. 

Lemma 20. For each i € [N], there exists a path in,-- - , io in the graph Go starting at i n = i, 
ending at io = j, o-nd such that each edge (ik,ik-l) is in E(tk) with tk ifc-i + A. 

Proof. We consider the graph G°° = ( [N] , E°° ) where E°° is the set of edges in Go that occur 
infinitely often. The lemma immediately follows from Dl. □ 

Proposition 21. In the decentralized model, for every j in [N], there exists some time 9j to 
such that for each 

Vm e [AN] : P m ,Aj(9j) > . 

Proof. At each time t E M, let us consider the directed graph G A (t) to be the communication graph 
of A A (t), i.e., 

G A (t) = ([AN],E A (t)) , 
where (m,n) 6 E A (t) if and only if A A n (t) > 0, and let 

G A = ([AN],U^ t0 E A (t)) . 

Properties (1) and (3) of the matrix A A (t) imply that for each index i S [N], the sequence of 
nodes A(i — 1) + 1, • • • , Ai is a path in G A (t), and that there is a self- loop at node Ai. Further if 
Ai lt i 2 (t) > 0, then property (2) for A A (t) guarantees that there is an edge in G A (t) from node Aii 
to some node in the path A(i2 — 1) + 1, • • • , Ai2 (namely, node Ai2 — 1 in Figure 1). 

Let m G [AA r ]; using Lemma [20l and the above properties of the graphs G A (t), we inductively 
construct a path mg, ■ ■ ■ ,mo in the graph G A starting at mi = m, ending at mo = Aj, and such 



15 



that each edge (m^, m^-i) is in E A (tk) with tk = to + k. Let us denote Oj(m) = tf, by definition of 
the matrix P{6j{m)), the existence of this path is equivalent to Pm,Aj(&j( m )) > 0. Finally, we let 

Qi = max (9 Am)) 
J me[AN] w ' 

and we use Lemma [bil to complete the proof. □ 

We now give a condition which ensures that the function ttj does not decrease when the set S A 
remains stationnary. 

Lemma 22. If Sj(t) = Sj(t + 1) and Sj(t) has no outgoing edge in the graph G(t + 1), then 

TTj(t+l) ^TTj{t). 

Proof. Let m G Sf (t), i.e., P m) Aj(t) > 0. We consider two cases: 

1. m is not a multiple of A. By relation Rl, we have 

Pm,Aj{t + 1) = Pm+XAiV-) ■ 

By Lemma O we get m G Sj 1 ^ + 1), i.e., P m ,Aj{t + l ) > °- Therefore, m + 1 G S^(t) and 
Pm,Aj(t + l) ^JTj(t). 

2. m is a multiple of A, i.e., m = Ai for some index i G [N]. By relation R2, we have 

N 

PAi,Aj(t + 1) = X) + !) P « fc ,Ai(i) , 

fc=l 

for some G {A(fc — 1) + 1, ... , A/c}. It follows that 

F A i,Aj(t+l) > Yl AiAt + l) P nk ,Aj(t) . 

kes 3 (t) 

Using Lemma [TBI and the definition of vrj(t), we obtain 

PAi,Aj( t + 1 ) > x X • 

Since z G Sj(t) and has no outgoing edge in the graph G(t + 1), we have 

N 

^ A iik {t + l) = J2 A i,k{ t + 1 ) ■ 

keSj(t) fc=l 

The latter sum is equal to 1 as the matrix A(t + 1) is stochastic. Hence Pai,Aj(* + 1) ^ 

□ 
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We now put it all together to prove Theorem [2j Let 

9 = max (8j) 
j=l..., N y J/ 

where the 9j 's are defined with regard to Proposition [2T1 Combining Lemma [T2l assumption A3 
with Lemmas [T5l \T7\ and [22] we obtain 

Vt > : Vj G [JV] : 7Tj(t) > a AiV . 

By Corollary [HI we derive |[-P(#) 1 — Na AN . In other words, we have shown that for any 
to ^ A — 1, there exists 9 ^ to such that 

p A (0)---^ A (t o )IU^ l-iVa AJV . 

Together with the sub-multiplicativity of the seminorm ||-||j_, this implies that 

lhn p A (t)..-yl A (0)m=0 . 

t— >+oo 

Theorem [1] follows from Proposition [9] and the definition of vector X(t). 



4 Generalizations and remarks 

In this section, we present diverse strengthenings of Theorems Q] and [2] which are obtained from 
direct generalizations of the arguments developed in the proofs of these theorems, or just simply 
by closely examining the proofs. We conclude by a discussion of examples which demonstrate the 
role of the various assumptions in Theorems [THS 



4.1 Eventual condition and coarser granularity 

Our proofs of theorems [3J and [5] are similar in the way we generalize the arguments in the proofs of 
Theorems [T] and [21 respectively. We present only one of them, the proof of Theorem [4] 

Suppose that condition OD holds for some time To and some positive integer We use 
the notation introduced in Section (3J Lemmas [T2VI171 and Lemma [22] for some time parameter 
to ^ max(To, A — 1). 

Assume that 

Sf(t) = ■■■ = Sf(t + $) . 

By definition of the sets 5 A and Sj, all the sets Sj(t), ■ ■ ■ ,Sj(t + <&) are then equal to some set of 
nodes, which we denote by S. Repeated application of Lemma [T7] show that S has no incoming 
edge in each of the communication graphs G(t + 1), • • • , G(t + $). Hence S has no incoming edge 
in H(t + 1). Condition OD then guarantees that S has no outgoing edge in H{t + 1). 

Suppose now that S has an outgoing edge (i,k) in some communication graph G{t + ip) with 
if G [$>]. Because of the self-loop assumption A2, we deduce that (i, k) is an outgoing edge of S 
in H{t + 1), a contradiction. Therefore, the set of nodes S has no outgoing edge in each of the 
communication graphs G(t + 1), • • • , G(t + and Lemma [22] implies that ir(t + <3?) ^ • • • ^ 7r(t) . 

Using the same arguments as for Theorem [2] we conclude that there exists 9 ^ to such that 

\\A A (9) ■ ■ ■ A A (t )\\±^ 1 - Na* AN . 

Theorem [4] then follows from sub-multiplicativity of the seminorm from Proposition [9] and 

from the definition of X(t). 
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4.2 Partial complete reducibility 

The proof of Theorem [5] is based on the remark that it suffices that one column of a stochastic 
matrix A be positive to ensure that A is contracting (with respect to the seminorm ||-||j_); see 
Corollary [8j 

Suppose that condition D* holds for some jo G [N]. We use the notation introduced in Section[3l 
Lemmas [T2TI171 and Lemma [22] for some time parameter to ^ A — 1 and for node jo. A close 
examination of the proof of Proposition [21] reveals that if the directed graph ([TV] , U s ^t E(s)) is jo- 
oriented (first part in condition D*), then the Ajo-th column of the matrix P is eventually positive, 
i.e., there exists some time 6q ^ such that for each 

Vme [AN] : Pm,Ajo(°o) > . 

Then Lemmas [17] and [22] lead us to relax the complete reducibility property into the following 
property for a directed graph G = (V, E), and a node jo € V. 

Pj : There exists no subset of V containing node jo with an outgoing edge and no incoming edge. 

We now study property P,- and give an equivalent, but more tractable expression of it. For that, 
we consider the condensation G* of G defined as the directed acyclic graph obtained by contracting 
each strongly connected component of G into a single node. We denote by i* the strongly connected 
component of some node i. 

The next lemma, whose proof is obvious, allows us to restrict ourselves to the case of acyclic 
graphs. 

Lemma 23. A directed graph G satisfies Pj if and only if the condensation G* of G satisfies Pj*. 

In turn, property P J0 on a directed acyclic graph G admits a simple equivalent expression in 
terms of the connected components of G. 

Lemma 24. If G is a directed acyclic graph, then G satisfies Pj if and only if (a) node jo is the 
one and only sink of its own connected component, and (b) every other connected component of G 
reduces to a single isolated node. 

Proof. For any node i, let /, I~ , and I + denote the connected component of i, the set of i's 
ancestors, and the set of i's descendants (both including i), respectively. 

First assume that (a) and (b) both hold. Let S be any subset of nodes with jo £ S, and suppose 
that (ko,ki) is an outgoing edge of S. Then, ko and k\ are in the same connected component. 
Condition (b) implies that k\ £ Jo- Since k± £ S, we have k\ ^ jo- By condition (a), k% is not a 
sink, and let hi be an outgoing neighbor of k\. If k<i G S, then (fei,^) is an incoming edge of S; 
otherwise, we repeat the argument with hi instead of k\. In this way, we construct a sequence of 
nodes k\, k%, ■ ■ ■ in the complement of S. Because G is acyclic, this sequence is finite, i.e., 5 has an 
incoming edge. 

Conversely, suppose that either (a) or (b) does not hold. We consider the following three cases, 
and show that for each of them, G does not satisfy ~Pj . 

1. The node jo is not a sink, i.e., jo has at least an outgoing neighbor k. Then, the set Jq has 
no incoming edge, but an outgoing edge, namely (jo, k). 
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2. The node jo is a sink and there is another sink, denoted i, in Jo. Then, i is not an isolated 
node and has an incoming neighbor k. The complement of {i} contains jo, has no incoming 
edge, but an outgoing edge, namely (k,i). 

3. There exists some edge (i,k) with i and k both outside Jo- Then, the set Jo U I~ has no 
incoming edge, but an outgoing edge, namely (i,k). 

□ 

As observed in [7] (Section 2, page 12), condition (a) in Lemma [23] can be expressed in terms 
of jo-orientation. 

Lemma 25. Let jo be any node of a connected and directed acyclic graph G. Then, node jo *s the 
one and only sink of G if and only if G is jo-oriented. 

We leave the simple proof of Lemma [25] to the reader. 

Finally, we compare orientation in a directed graph and in its condensation in the following 
lemma whose proof is trivial. 

Lemma 26. The directed graph G is jo-oriented if and only if the condensation of G is jg- oriented. 

By combining the above four lemmas, we obtain an equivalent form of P, . 

Proposition 27. Let G be a directed graph, and let jo be any node of G. The following two 
properties are equivalent. 

1. G satisfies Pj . 

2. The connected component of jo in G is jo-oriented, and every other connected component is 
strongly connected. 

The end of the proof of Theorem \5\ is similar to the one of Theorem [2] except that the upper 
bound on the seminorm of matrix P(9o) is now 

\\A A (eo)---A A (to)\\ ± ^l-a AN . 

4.3 Examples 

We now present two examples that demonstrate the roles of the self-loop assumption A2 and of the 
conditions C, D. or D* in our convergence theorems. In both we consider the case of a synchronous 
system with 3 agents; in other words, N = 3 and A = 1. 

In our first example, the sequence of matrices (A(t))tew is 3-periodic with 
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1 " 
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A(0) = 
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1 





, A(2) = 
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1 







1 
















1 



The sequence of matrices corresponds to the following scenario in the synchronous case. Agent 1 
communicates only with itself while agent 2 communicates with agent 3 and agent 3 communicates 
with agent 2, but none of the two agents 2 and 3 takes into account their own values. This first 
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round is then repeated infinitely often while rotating the communication graph. We easily check 
that the algorithm actually keeps executing the instruction (xi,X2, X3) := (xs,X2, x\). Therefore, 
the algorithm does not achieve consensus, and does not even converge. However, condition D and 
all the assumptions considered so far hold except A2. In fact, we even observe that the self-loops 
which occur at each node during every period of duration 3 units of time do not help to achieve 
asymptotic consensus. 

We now briefly recall an example given in [2], which shows how crucial is the fact that the 
agent j in conditions C or C* does not change over time. Here, x(0) = (0, 1, 0) and the matrices in 
the sequence (A(t))tew are taken in the set {A\, A3} where 



1/2 1/2 
1 
1 



An 



1 
10 

1/2 1/2 



, ^3 



10 
1/2 1/2 
1 



Given an increasing sequence of integers (t n ) n eIN with to = and to be chosen suitably later, we let 

A(t) = A k 

when t^i+k—l ^ t < for some non-negative integer i. This means, for instance, that until 

time ti, agent 3 communicates with agent 1, and agent 1 forms the average of its own value and 
the value received from agent 3. 

Let (e ra ) ng ]N* be a sequence of positive reals such that I = Y^=i e n < 1/2- Times t\ and £2 are 
chosen large enough to have x\{t\) ^ 1 — ei and £3 (£2) ^ ei- Similarly, t% and £4 are chosen large 
enough to have £2(^3) ^ 1 — £i — £2 and x\{t±) ^ ei + £2, and so on. The resulting vector x(t) is 
such that each of its three entries is infinitely often at least equal to 1 — i and infinitely often at 
most equal to I. Since i < 1/2, this proves that the sequence (x(t))t£N is not convergent. 

In this example, all the assumptions A, B, and Dl hold. Moreover, the following weakening 
of D* is satisfied: at every time t € IN, there is some j G [N] such that the connected component 
of j in the communication graph G(t) is j-oriented, and every other connected component of G(t) 
is strongly connected. Indeed, all the communication graphs have two connected components: one 
component is reduced to a single node with a self- loop, and the other one is oriented with respect 
to one single node (namely, node k for the matrix Ak). 
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